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ABSTBACT 


The  ability  to  forecast  the  acadeaic  performance  of 
Naval  Officer  students  in  the  Operations  Analysis  curriculum 
is  an  issue  of  importance  to  the  Navy.  In  the  interest  of 
cost  effectiveness  and  achieving  the  required  numbers  of 
operations  analysis  graduates,  this  thesis  studies  the 
present  student  selection  factors  for  the  OA  curriculum  and 
suggests  several  alternative  factors  to  improve  the  selec¬ 
tion  decision.  An  analysis  of  variance  approach  vas  taken 
to  explore  the  relationship  of  the  student's  academic 
profile  code  and  several  other  variables  to  determine  their 
importance  in  explaining  the  OA  student’s  academic  perform¬ 
ance.  A  study  of  159  Navy  OA  students  vas  completed.  The 
analysis  shoved  the  student *s  overall  total  college  grade 
point  average,  the  tine  from  completion  of  college  to 
commencement  of  vork  in  the  OA  curriculum  (in  fact  perform¬ 
ance  does  not  decrease  over  time),  the  student's  designator 
and  his  college  degree  to  be  the  most  important  factors  in 
explaining  the  variability  of  student  performance. 
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I.  INTRODUCTION 


The  purpose  of  this  thesis  was  to  investigate  various 
factors  affecting  the  academic  performance  of  Naval  Officer 
students  in  the  Operations  Analysis  curriculum  at  the  Naval 
Postgraduate  School.  The  original  goal  was  to  arrive  at  a 
predictive  model  which  would  improve  the  present  selection 
process  and  possibly  reduce  the  numbers  of  student  academic 
transfers  out  of  the  Operations  Analysis  Curriculum.  These 
transfers  have  historically  been  about  10%  of  the  original 
class.  Due  to  the  relatively  small  sample  size  (159),  it 
was  not  possible  to  cross  validate  .  Because  of  this  the 
results  are  not  presented  as  a  predictive  model.  The 
utility  of  the  study  is  rather  in  its  analysis  of  those 
factors  influencing  the  student's  academic  performance;  the 
resultant  promotion  of  understanding,  and  suggestions  for 
further  study  of  the  subject. 

The  pertinent  variables  that  were  readily  available  and 
are  in  this  study  are  college  QPR,  college  degree,  the 
Officer's  designator,  college  quality  rating,  elapsed  time 
from  completion  of  college  to  starting  the  Operations 
Analysis  Curriculum,  year  graduated  from  the  OA  Curriculum, 
and  the  length  of  refresher  attended  at  the  Naval 
Postgraduate  School.  Current  practice  using  only  the  "APC" 
codes  as  a  predictor  achieves  a  multiple  correlation  coeffi¬ 
cient  of  .21  when  run  through  the  ANOVA  package.  The  model 
recommended  in  the  study  has  an  B2  of  .41  while  another 
model  achieves  an  R2  as  high  as  .53. 

The  study  subjects  include  approximately  one-half  of  the 
Navy  OA  graduates  from  the  period  1974  to  1985.  This  was 
the  case  since  APC's  were  only  available  for  about  one-half 
of  the  graduates.  The  study  includes  only  those  students 
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with  academic  profile  codes  of  435  or  better.  The  recom¬ 
mended  A  PC  for  the  Operations  Analysis  Curriculum  is  324  or 
better.  There  were  43  individuals  included  in  the  study 
whose  APC  was  ,at  least  in  one  of  the  three  digits,  outside 
that  recommended  for  OA.  Cf  these  43  people,  6  went 
straight  into  the  curriculum  without  any  refresher. 

A  review  of  the  literature  reveals  a  thesis  written  by 
Heru  Soetrisno  in  1975  titled  "Prediction  of  Academic 
Performance  of  the  U.  S.  Navy  Officer  Students  in  the 
Operations  Eesearch/Systems  Analysis  curriculum  at  the  Naval 
Postgraduate  School"  £fief.  1  ].  The  study  was  a  regression 
analysis  using  biographical  data,  a  personal  interest  survey 
and  the  graduate  record  examination.  It  covered  all  the 
Navy  students  in  OA  in  the  Spring  of  1974  (72  students)  . 

The  thesis  concluded  that  the  three  above  mentioned  vari¬ 
ables  and  combinations  of  them  were  better  predictors  of 
student  performance  than  undergraduate  QPR  and  college 
quality. 

Numerous  articles  have  alsc  been  written  concerning  the 
subject  of  predicting  academic  performance.  A  review  of 
many  of  these  articles  has  left  the  author  with  the  impres¬ 
sion  that  it  is  clearly  not  a  clean-cut  issue  as  to  what 
test  cr  measure  is  the  best  in  predicting  academic  perform¬ 
ance.  However  of  all  the  choices,  it  is  recognized  that 
prior  academic  performance  and  aptitude  tests  are  generally 
considered  to  the  most  important  predictors  of  future 
academic  performance  [Bef.  2:  page  10]. 

The  study  opens  with  the  development  of  the  academic 
profile  code  and  a  review  of  the  data.  The  analysis  is 
conducted  by  first  a  preliminary  look  at  the  independent 
variables  in  relationship  to  the  dependent  variable  and  then 
with  an  analysis  of  variance  technique.  The  study  ends  with 
several  conclusions  and  recommendations  for  future 
consideration. 


II.  BACKGBQGND 


The  Navy  Military  Personnel  Command  (NMPC)  is  respon¬ 
sible  for  filling  quotas  at  the  Naval  Posgraduate  School. 
The  current  procedure  is  to  convene  annually  a  Graduate 
Selection  Board  [Bef.  3].  This  board  meets  and  reviews 
those  Officer's  records  who  are  potentially  eligible  for 
graduate  education  as  shown  in  enclosure  four  of  [Bef.  3]. 
The  beard  bases  their  deteraination  for  possible  graduate 
education  on  the  Officer* s  professional  performance  and 
their  acadeaic  ability  as  evidenced  by  their  academic 
profile  code  (APC)  [  Bef •  4].  The  nost  recent  board  screened 
13,000  records  and  selected  4,000  for  possible  graduate 
studies.  Approximately  90 5C  of  those  students  eventually 
completing  fully  funded  graduate  studies  will  receive  their 
degrees  from  the  Naval  Postgraduate  School  [Bef.  5:  page 
25]. 

The  APC  is  a  three  digit  code  summarizing  the  previous 
education  of  each  Officer  and  is  calculated  as  seen  in 
Figure  2.1  . 

Appendix  B  is  a  sample  acadeaic  record  evaluation  (ABE) 
sheet.  The  ABE  is  used  by  the  director  of  admissions  at  the 
Naval  Postgraduate  School  as  a  worksheet  to  compute  an  APC 
for  every  newly  designated  Naval  Officer  each  year.  The  ABE 
is  filed  and  maintained  at  the  Director  of  Admission's 
office  at  the  Naval  Postgraduate  School  and  is  kept  on  file 
until  the  Officer  has  been  designated  as  a  subspecialist  or 
has  been  determined  not  suitable  for  graduate  education. 
NMPC  annually  directs  the  Naval  Postgraduate  School  to 
remove  and  destroy  the  ABE's  for  those  above  mentioned 
Officers. 


OPR  COOE 
(1st  WC  DTqit) 


MATH  CODE 
(2nd  APC  njnit) 


£ode  #  Grade  QPR  Range  Code  # 


0 

A-/A 

3.60  - 

4.00 

0 

1 

B+ 

3.20  - 

3.59 

2 

R-/B 

2.60  - 

3.19 

3 

C+ 

2.20  - 

2.59 

1 

4 

C 

1.90  - 

2.19 

5 

Below  C 

0.00  - 

1.89 

2 


{Repeated' courses  and  failures 
I  are  included  in  the  QPR  calcu¬ 
lation.)  3 


Calculus-Related  Math  Courses 

Siontficant  post-calculus  math  with 
B  averaqe 

Two  or  more  calculus  courses  with 
R*  averaqe 

Two  or  more  calculus  courses  with 
C*  averaqe 

One  calculus  course  with 
C  grade  or  better 


4  Two  or  more  ore-calculus  courses  with 
B  average  or  better 

5  At  least  one  pre-calculus  course  with 

C  qrade 

6  No  col leqe-level  math  with  C  qrade 


TECHNICAL  CODE 

(3rd  PC'Biqit) 

Siqnificant  Upper-Oi vision  Course 
Coveraqe  in  a  Pertinent  Fnqineerinq 

Code  I  Physics  (Calculus-Based)  or  Physical  Science  Qiscipline 
0  ........... ......... .............. ........  R*  averaqe 

1  .............................. C*  averaqe 

2  Complete  sequence  taken  with 

B+  averaqe 


3  Complete  sequence  taken  with 

C ♦  averaqe 

4  At  least  one  course  with 

C  grade 

5  None 


Figure  2.1 


Calculating  APC's. 
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The  APC  is  originally  based  oa  the  individuals  college 
pecforaance  and  rarely  changes  unless  the  individual  corre¬ 
sponds  with  the  Director  of  Admissions  at  the  Haval 
postgraduate  School  and  petitions  to  raise  (improve)  his  APC 
with  written  proof  of  additional  accredited  academic 
achievement  [fief.  4:  page  11]. 

A  Naval  Officer  must  possess  an  APC  of  324  or  better 
(e.  g.  112)  to  directly  enter  the  Operations  Analysis 
Curriculum  [Ref.  5:  page  32].  Additionally,  a  Naval  Officer 
may  enter  the  OA  Curriculum  with  an  APC  of  344  after 
completing  one  or  two  guarters  of  the  Engineering  Science 
Curriculum.  The  Engineering  Science  Curriculum  is  designed 
to  provide  an  opportunity  for  officers  with  inadequate  math¬ 
ematical  and  physical  science  backgrounds  to  establish  a 
good  math  foundation  to  be  able  to  gualify  for  a  technical 
curriculum  [Ref.  5:  page  36].  There  is  also  a  six  week 
refresher  available  that  is  designed  to  rapidly  cover  the 
calculus  and  physics  fundamentals  for  those  officers  who  are 
direct  inputs  into  the  OA  curriculum  without  any  quarters  of 
Engineering  science.  Exceptions  are  made  and  it  is  possible 
for  an  individual  to  enter  the  OA  curriculum  without  the 
minimum  APC.  It  is  also  possible  for  an  Officer  to  start  OA 
without  any  refresher  at  all  as  did  63  of  the  study 
sub  jects. 

The  OA  curriculum  is  of  a  technical  nature  and  students 
with  solid  college  performance  and  technical  majors  are 
encouraged  to  enroll  in  it.  However,  there  are  some  very 
good  professional  Officers  who  do  not  have  the  required 
academic  background  to  directly  enroll  in  OA.  The  Navy 
would  like  some  of  these  Officers  to  be  able  to  attend  NPS 
in  a  technical  curriculum  .  In  response  to  this  need,  the 
Navy  has  recently  introduced  (1985)  the  Technical  Transition 
Program  (TTP) .  This  program  is  designed  to  allow  those 
professionally  exceptional  officers  with  weak  college 


backgrounds  to  enter  a  technical  curriculum  via  a  one  or  tvo 
guarter  individually  tailored  preparation  program.  This 
program  is  slightly  different  from  the  Engineering  Science 
curriculum  in  that  it  is  individually  structured  to  meet 
each  student's  needs  while  it  also  varies  from  different 
curriculum  to  curriculum.  This  program  not  only  provides  an 
opportunity  to  Officers  that  at  one  time  had  no  or  little 
hope  cf  attending  the  Naval  Postgraduate  School  but  it  also 
provided  more  graduate  trained  subspecialists  for  the  Navy. 

The  college  records  of  these  candidates  for  the  TTP  are 
screened  at  the  Naval  Postgraduate  School  and  a  decision  is 
made  whether  or  not  to  allow  an  individual  to  start  the 
program  in  hopes  of  eventually  entering  a  technical  curric¬ 
ulum.  This  study  reveals  several  important  factors  and 
considerations  in  order  to  help  the  decision  maker  better 
access  the  potential  academic  performance  of  future  OA 
students. 


III.  DISCPSSIOII  Of  fl£  DATA 


The  study  data  vas  gathered  from  several  sources 
including  the  Office  of  the  Registrar,  Director  of 
Admissions,  the  Operations  Analysis  Curricular  office  at  the 
Naval  Postgraduate  School  and  from  the  Naval  Military 
Personnel  Coaaand.  Host  of  the  data  vas  obtained  fron  the 
individual  student  files  maintained  by  the  operations 
Analysis  curriculua  secretary.  These  files  contained  much 
of  the  student  data  such  as  university  attended  and  what 
dates  attended,  college  degree,  designator  and  length  of 
refresher  attended  at  the  Naval  Postgraduate  school.  These 
same  files  contain  the  student's  grade  sheet  summary  of  all 
course  work  completed  at  the  Naval  Postgradute  School.  From 
this  sheet,  the  dependent  variable  in  the  study  was  calcu¬ 
lated.  Four  different  quality  point  ratings  (QPS)  were 
studied.  The  first  was  the  student's  total  grade  average 
after  four  quarters  of  the  Operations  Analysis  Curriculum. 
This  grade  is  of  special  importance  as  it  is  at  this  point 
in  the  curriculum  that  a  final  decision  must  be  made  as  to 
continue  a  marginally  performing  student  in  hopes  that  his 
overall  grade  point  average  will  improve  or  to  allow  him  to 
possibly  transfer  to  another  curriculum  with  enough  time 
remaining  to  successfully  complete  that  program.  It  is  also 
important  to  note  that  through  the  first  four  quarters  each 
option  is  essentially  the  same.  Hence,  there  is  uniformity 
in  the  program.  If  a  model  could  be  constructed  that  would 
improve  the  present  selection  process  and  reduce  the  numbers 
of  these  transfers,  a  savings  in  time  and  money  could  be 
realized  by  the  Navy. 

The  three  other  dependent  variables  looked  at  were  the 
student's  quality  point  rating  after  six  guarters  (when  most 


of  the  stringent  course  requirements  are  finished),  his 
graduate  gpr  after  eight  guarters  and  also  the  total  overall 
quality  point  rating  after  eight  quarters  which  completes 
the  degree,  ill  these  qpr' s  were  determined  by  dividing  the 
weighted  total  of  the  grade  points  earned  by  the  total  hours 
attempted  for  the  respective  quarter  totals.  None  of  these 
qpr*s  included  any  grades  earned  during  refresher  courses. 

The  academic  profile  codes  were  the  most  difficult  data 
points  to  obtain.  Although  the  Director  of  Admissions  main¬ 
tains  a  computer  printout  of  all  current  APC's,  very  few  of 
tne  study  subjects  were  still  on  the  listing.  Of  the  343 
Navy  CA  students  completing  the  Operations  Analysis  curric¬ 
ulum  at  the  Naval  Postgraduate  School  from  1974  to  1985, 
only  60  of  them  had  APC's  in  the  printout,  in  their  files  or 
in  their  academic  record  evaluation  sheets.  The  additional 
APC's  were  obtained  from  the  Officer's  data  card  sent  to  the 
Naval  Postgraduate  School  by  NMPC.  A  total  of  172  APC's 
were  obtained.  Of  these  172  APC's,  159  were  used  in  the 
study.  The  thirteen  individuals  removed  from  the  study  were 
in  very  low  populated  levels  of  several  of  the  variables. 
The  variables  for  the  academic  profile  codes  are  seen  in 
Figure  3.1  . 

The  159  Naval  Officer  study  subjects  all  graduated  with 
Naster  Degrees  in  Operations  Analysis.  Although  not  a 
random  sample,  they  were  treated  as  a  random  sample  for  the 
purpose  of  the  study.  There  was  no  apparent  grouping  or 
special  distribution  of  the  study  subjects  compared  to  the 
entire  population  of  343.  The  data  were  tabulated  into  an 
159  by  18  matrix  and  is  included  as  Appendix  C. 

The  variable  college  rating  was  obtained  from  the 
Gourman  Eeport  [Bef.  6s  page  7].  This  report  evaluated 
1,845  colleges  and  universities  in  terms  of  the  institu¬ 
tion's  objectives,  curriculum,  faculty,  faculty  research  and 
honors,  administration,  library,  budget,  resources,  student 
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Figure  3.  1  APC  Main  Effects. 


scores  on  standardized  tests,  admission  policy,  and  several 
other  factors.  The  range  for  the  college  rating  variable  as 


a  cofactor  was  4.99  for  the  highest  rated  institution  down 
to  a  rating  of  2.01  for  the  lowest.  This  variable  was  also 
looked  at  as  a  possible  main  effect  and  was  divided  into 
categories  as  seen  in  Figure  3.2  . 
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strong 
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34 
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18 
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3.01-3.50 
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19 
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2.01-2.99 
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total 

159 

Figure  3.2  College  Bating. 


The  variable  college  degree  is  seen  in  Figure  3.3  .  The 
grouping  Naval  Science  was  reguirea  due  to  the  twelve 
students  included  in  the  study  who  graduated  from  the  Naval 
Academy  prior  to  197  3.  Prior  to  that  time  only  one  degree 
was  confirmed  by  the  institution  and  although  the  midshipmen 
took  a  variety  of  courses,  many  of  wnich  were  of  an  engi¬ 
neering  nature,  they  received  a  B. S.  degree  in  Naval 
Science. 

The  variable  refresher  was  investigated  as  both  a  main 
effect  (yes=attendea  cr  no=did  not  attend)  and  as  a  cofactor 
listing  the  length,  in  guarters,  of  refresher  taken  at  the 
Naval  Postgraduate  School.  There  is  a  sir  week  rerresher 
for  each  class  prior  to  starting  the  curriculum. 
Additionally,  a  student  may  possibly  receive  one  or  two 
guarters  or  refresher  depending  on  several  factors.  These 
guarters  of  refresner  are  generally  undertaken  by  students 
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Figure  3.3  College  Degree. 

not  aeeting  the  minimum  recommended  APC  for  OA  or  for 
students  who  have  not  been  in  an  academic  environment  for  a 
long  period  of  time.  The  decision  is  generally  made  at  the 
Curricular  Officer  and  Academic  Associate's  concurrence  and 
vith  approval  from  the  student's  detailer.  There  is  nothing 
concrete  about  this  process  and  it  is  possible  to  start  the 
curriculum  directly  without  any  refresher.  The  cofactor 
length  of  refresher  was  grouped  as  seen  in  Figure  3.4  . 

The  variable  designator  vas  viewed  as  a  main  effect. 
Each  Naval  Officer  has  one  designator  which  is  generally 
assigned  after  completing  a  school  or  training  course.  They 
retain  this  designator  for  their  entire  length  of  service 
with  the  few  exceptions  of  individuals  transfering  to 
another  specialty  and  hence  changing  designators.  The 
designators  of  the  study  group  can  be  seen  in  Figure  3. 5  . 

Table  I  is  a  summary  listing  of  all  the  variables  and 
their  levels  that  were  investigated  in  the  study. 
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Figure  3.5  Designator. 
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TABLE  I 

EXPLA1ATI0H  OP  THE  STUDY'S  TABIABLES 


Cofactors 

time  since  college  in  months 
college  rating 
year  graduated  from  NPS 
length  of  refresher  (quarters) 
Main,.  Effects 


Values 

23-178 

2.01-4.99 

74-85 

0,  .5,  1,  2 
Level 


APC1  college  qpr  * 
APC2  math  code  * 

APC3  technical  code  * 

College  Degree 


1,2, 3, 4, 5 
1,2, 3, 4 
1,2, 3, 4, 5, 6 
Level 


Business  1 

Engineering  2 

Humanities  3 

Natural  Science  (Math)  4 

Social  Science  5 

Naval  Science  6 

Operations  Analysis  7 

Designator  Level 


llOx  Restricted  line  1 
lllx  Unrestricted  line  2 
112x  Submarines  3 
131x  Aviator  4 
132x  Naval  flight  officer  5 
140x  Engineering  Duty  officer  6 
161x  Intelligence  officer  7 
310x  Supply  officer  8 
113x  Special  Warfare  officer  9 


*  Coded  as  APC  ♦  1  for  computer  indexing 
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17.  PEELIfllHABT  AH ALTS IS  OF 


DATA 


A  preliminary  analysis  of  the  data  was  conducted  using 
APL  and  Grafstat  capabilities  of  the  IBM  370  located  at  the 
Naval  Postgraduate  School.  Each  variable  was  investigated 
in  relation  to  the  dependent  variable  "4th  quarter  qpr". 
All  remarks  of  significant  differences  are  a  result  of  a 
formal  "t"  test  with  a  .05  level  of  significance. 

A.  4IH  QUAETEB  QPB  7EBSOS  A PC  1 

The  first  APC  digit  representing  the  individual's 
overall  college  qpr  was  plotted  against  his  academic 
performance  in  the  OA  curriculum  through  the  fourth  quarter. 
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AT  GOVERNMFN  I  FtPENSE 


Figure  4.1  is  a  graphical  representation  of  the  statistical 
relationsnip  while  the  results  are  tabulated  in  Table  II. 


TABLE  II 

4th  QTB  QPB  TS  APC1 


CATEG. 

NO.PTS 

%-PTS 

Y-MEAN 

Y-DVN 

.25 

.50 

.75 

ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

0 

8 

0.050314 

3.72 

0.24068 

3.43 

3.63 

3.96 

1 

28 

0.1761 

3.5386 

0.27132 

3.36 

3.47 

3.75 

2 

79 

0.49686 

3.3448 

0.3088 

3.09 

3.34 

3.59 

3 

39 

0.24528 

3.2826 

0.32053 

3.07 

3.25 

3.46 

4 

5 

0.031447 

3.042 

0.34672 

3.02 

3.11 

3.15 

These  results  show  the  student's  performance  in  college  has 
a  direct  and  logical  relationship  to  hxs  performance  through 
the  fourth  guarter  of  the  OA  curriculum.  The  higher  one's 
college  qpr  tne  better  one's  performance  in  OA.  The  study 
group's  average  APC  for  the  first  digit  is  very  close  to  two 
while  the  overall  grand  mean  for  their  fourth  guarter  grade 
was  3.37.  The  highest  code  of  zero  had  a  significant 
difference  compared  to  the  overall  mean. 

B.  4TB  QUABTEB  QPB  fEBSOS  APC 2 

The  second  APC  digit  representing  the  student's  under¬ 
graduate  calculus  proficiency  was  plotted  against  his  4th 
guarter  gpr.  Figure  4. 2  is  a  representation  of  this  rela¬ 
tionship  and  the  numerical  results  are  tabulated  in  Table 
III.  There  is  a  significant  difference  among  the  first  two 
levels  of  this  variable  and  the  overall  mean.  The  recom¬ 
mended  APC  for  QA  in  math  is  three  or  better  while  four  is 
acceptable  via  the  engineering  science  curriculum.  The 
study  group's  average  was  1.7  while  the  entire  group  had  a 
math  APC  of  three  or  better.  Tne  overall  relationsnip  is 
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TABLE  III 

4TH  QTR  QPB  TS  APC2 


CATEG. 

NO.PTS 

%-PTS 

Y-MEAN 

Y-DVN 

.25 

.50 

.75 

ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

0 

24 

0.15094 

3.4963 

0.26836 

3.29 

3.43 

3.75 

1 

29 

0.18239 

3.5034 

0.2918 

3.29 

3.59 

3.7 

2 

76 

0.47799 

3.3143 

0.32307 

3.08 

3.3 

3.49 

3 

30 

0.18868 

3.297 

0.3607 

3.03 

3.22 

3.58 

u 
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T1BLE  If 

4TH  QTB  QPB  TS  APC3 


CATBG. 

NO.PTS 

%-PTS 

Y-MEAN 

Y-DVN 

.25 

i 

O  1 
m 

•  l 

! 

.75 

ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

0 

4 

0.025157 

3.705 

0.17642 

3.5 

3.59 

3.77 

1 

19 

0.1195 

3.4511 

0.33468 

3.05 

3.46 

3.79 

2 

25 

0.15723 

3.3636 

0.29094 

3.1 

3.29 

3.6 

3 

59 

0.37107 

3.3958 

0.29821 

3.16 

3.36 

3.63 

4 

39 

0.24528 

3.2379 

0.3671 

3.96 

3.26 

3.46 

5 

13 

0.081761 

3.4769 

0.27921 

3.29 

3.46 

3.73 

were  statistically  significant  were  the  first  level  zero  and 
the  next  to  last  level  four. 


D.  41H  QUABTEB  QPB  VERSOS  C0L1EGE  DEGREE 


College  degree  was  the  next  variable  plotted  against  the 
4th  guarter  gpr.  Figure  4.4  graphically  presents  and  Table 
V  lists  this  data. 

Although  none  of  the  differences  are  statistically 
significant,  the  business,  engineering,  oath  and  operations 
analysis  majors  performed  above  the  mean  of  the  study 

sample.  If  one  disregards  an  outlier  or  two  within  the  OA 

level,  OA  would  have  shown  a  greater  positive  difference 
from  the  grand  mean  and  this  can  be  seen  in  its  inter- 

guartile  range.  The  data  shows  an  intuitively  logical 

assumption  that  students  with  a  social  science  or  humanities 
undergraduate  degree  would  do  less  well  in  a  technical 
curriculum  when  compared  to  students  with  a  more  quantita¬ 
tive  college  degree  such  as  engineering  or  mathematics.  The 
performance  of  those  people  with  naval  science  majors  is 
relatively  low.  This  may  be  a  result  of  several  confounding 
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Figure  4.4  4th  QTB  QPB  TS  College  Degree 


TABLE  ¥ 

4 TH  QTB  QPB  VS  COLLEGE  DEGBEE 


NO.PTS  %-PTS 


Y-MEAN  Y-DVN 


.25  .50 


ALL 

159 

i 

3.373 

0.33011  3.12 

3.36  3.64 

BUSINESS 

14 

0.08805 

3.4657 

0.30352  3.31 

3.43  3.61 

ENGINEERING 

31 

0.19497 

3.4274 

0.32373  3.11 

3.41  3.77 

HUMANITIES 

4 

0.025157 

3.2475 

0.3447  2.93 

3.11  3.12 

MATH 

59 

0.37107 

3.4037 

0.31953  3.17 

3.37  3.69 

SOCIAL  SCI 

16 

0.10063 

3.2306 

0.32225  3 

3.16  3.43 

NAVAL  SCI 

12 

0.075472 

3.1875 

0.28902  2.99 

3.11  3.3 

OA 

23 

0.14465 

3.3822 

0.33327  3.26 

3.42  3.53 

E.  4IH  QUABTEB  QPB  VEBSOS  DESIGNATOB 

The  student's  designator  vas  the  neit  variable  plotted 

against  4th 

quarter  gpr. 

Disregarding  the  very 

small  levels 

of  1400,  1610, 

and  1130 

f  roffl 

the  discussion. 

leaves  only 

28 

*  "  ■  ,**  J>  **  **  •  '  X-  *<' 

1120  (submariners) ,  1320  (naval  flight  officers)  and  3100 

(supply)  designators  that  did  better  than  the  grand  mean. 
This  can  be  seen  in  Figure  4.5  and  Table  VI.  A  test  of 
significance  showed  only  the  1120  and  3100  designators 
performed  better  and  the  1100  designator  performed  worse 
than  the  overall  mean. 
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Figure  4.5  4th  QTB  QPR  VS  Designator. 


F.  4TH  QUARTER  QPB  VEBSDS  LENGTH  OF  REFRESHER 

The  variable  length  of  refresher  was  plotted  against  4th 
quartet  gpr  as  seen  in  Figure  4.6  and  TaLle  VII. 

It  can  be  seen  that  those  individuals  who  do  not  attend 
refresher  do  slightly  better  than  the  students  that  attend 
refresher.  This  could  mean  that  a  good  job  is  done  identi¬ 
fying  those  individuals  who  need  refresher.  It  is  also 


TABLE  VI 

4IH  CTfi  QPB  VS  DESIGBATOB 


4 

CATBG. 

NO.PTS 

%-PTS 

Y-MEAN 

Y-DVN 

.25 

.50 

.75 

$ 

— 

— 

— 

— 

ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

1100 

6 

0.037736 

3.3517 

0.30954 

3.07 

3.34 

3.63 

m 

1110 

50 

0.31447 

3.2456 

0.31481 

3.04 

3.19 

3.43 

1120 

10 

0.062893 

3.654 

0.32855 

3.35 

3.82 

3.96 

ML 

1310 

41 

0.25786 

3.341 

0.23245 

3.15 

3.37 

3.47 

1320 

26 

0.16352 

3.4588 

0.31471 

3.26 

3.46 
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0.0062893 

3.29 
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Figure  4.6  4th  QTB  QPB  VS  Length  of  Befresher. 

possible  that  the  students  tnemselves  have  an  influence  in 
wnether  or  not  they  attend  refresher.  It  could  also  be  that 
those  students  that  have  a  very  confident  opinion  of  their 
academic  background  may  be  deliberately  deciding  not  to 
report  until  well  after  refresher  starts.  This  sort  of 


TABLE  VII 

41H  QTB  QPB  TS  LENGTH  OF  BEFBESHEB 


CATEG. 

NO.PTS 

%-PTS 

Y-MEAN 

Y-DVN 

.25 

.50 

.75 

ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

0 

63 

0.39623 

3.441 

0.33443 

3.15 

3.42 

3.77 

0.5 

58 

0.36478 

3.3597 

0.32014 

3.11 

3.32 

3.6 

1 

8 

0.050314 

3.54 

0.29039 

3.17 

3.43 

3.73 

2 

30 

0.18868 

3.2117 

0.28024 

3.03 

3.15 

3.43 

biased  selection  coaid  be  affecting  the  results  of  this 
variable.  The  result  of  the  students  with  one  guarter  of 
refresher  doing  better  than  the  mean  could  also  be  artifi¬ 
cial.  once  they  demonstrated  that  even  though  they  fit  the 
category  of  individuals  who  should  get  refresher,  they 
really  could  handle  the  pace  without  it  then  they  could  be 
set  back  into  their  original  class  with  a  few  scheduling 
arrangements  made.  There  is  also  no  permanent  incentive  to 
do  well  ir  the  460  curriculum  since  the  grades  do  not  count 
and  are  not  reflected  in  the  student's  total  grade  average. 
The  formal  test  of  significance  showed  that  onxy  the 
students  with  two  guarters  of  refresher  performed  at  a 
statistically  lower  level  than  the  overall  grand  mean. 

G.  4TH  QUARTER  QPB  VERSUS  COLLEGE  BATING 

The  variable  college  rating  was  the  next  variable 
plotted  against  4th  guarter  gpr  and  is  shown  in  Figure  4.7 
and  Table  VIII.  The  data  does  not  show  a  significant 
difference  among  any  of  the  college  ratings.  Disregard  the 
lowest  rating  as  it  only  contains  three  individuals.  The 
remaining  four  categories  shew  a  slight  decrease  in  4th 
guarter  gpr  as  the  rating  decreases  but  it  is  not  statisti¬ 
cally  significant. 
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COLLEOE  RATING 
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Figure  4.7  4th  Qtr  QPH  TS  College  Bating. 


TABLE  VIII 

4TH  QOARTEB  QPB  VEBSOS  COLLEGE  BATING 


CATBG. 

NO.FTS 

%-PTS 

Y-MEAN 

Y-DVN 

.25 

.50 

.75 

ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

2.0-2.99 

3 

0.018868 

3.3967 

0.26081 

3.16 

3.27 

3.76 

3. 0-3. 5 

19 

0.1195 

3.4005 

0.29915 

3.07 

3.43 

3.69 

3.5-3.99 

18 

0.11321 

3.3 

0.28746 

3.12 

3.28 

3.43 

4. 0-4. 4 

85 

0.53459 

3.3554 

0.32538 

3.11 

3.35 

3.56 

4.41-4.99 

34 

0.21384 

3.4382 

0.36992 

3.12 

3.4 

3.81 

H.  41H  QUARTER  QPB  VERSUS  YEAR  GRADUATED  FROM  BPS 

The  variable  year  graduated  froa  NPS  was  plotted  against 
4th  quarter  qpr  and  is  seen  in  Figure  4.8  and  Table  IX.  The 
data  is  seen  to  be  heavily  concentrated  in  the  three  aost 
recent  years  (4b%  of  all  study  subjects).  The  years  74  and 
75  showed  a  statistically  significant  mean  that  was  oelow 
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TABLE  IX 

4IH  QOABTEfi  QPB  TEBSOS  XEAB  GRADUATED  FBOH  EPS 


NO.PTS  %-PTS  Y-MEAN  Y-DVN 


.25  .50  .75 


ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

974 

8 

0.050314 

3.1388 

0.24174 

3.04 

3.11 

3.29 

975 

12 

0.075472 

3.1825 

0.25898 

2.99 

3.09 

3.31 

976 

7 

0.044025 

3.4314 

0.25525 

3.08 

3.5 

3.59 

977 

7 

0.044025 

3.47 

0.21024 

3.22 

3.45 

3.67 

978 

2 

0.012579 

3.515 

0.085 

3.43 

3.43 

3.6 

979 

14 

0.08805 

3.3514 

0.33939 

3.03 

3.36 

3.53 

980 

9 

0.056604 

3.6178 

0.21186 

3.58 

3.69 

3.76 

981  ► 

11 

0.069182 

3.2918 

0.28074 

3.1 

3.15 

3.48 

982 

15 

0.09434 

3.4433 

0.39383 

3.27 

3.56 

3.76 

983 

31 

0.19497 

3.3881 

0.355 

3.08 

3.39 

3.7 

984 

27 

0.16981 

3.3441 

0.2765 

3.14 

3.32 

3.47 

985 

16 

0.10063 

3.4381 

0.37902 

3.26 

3.43 

3.82 
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Figure  4.9  4th  Quarter  QPB  Ts  Tree  Since  College. 

relative  constant  performance  over  this  variable  is 
surprising  as  one  would  logically  expect  performance,  to  be 
degraded  as  the  time  since  completing  college  and  commencing 
another  academic  situation  increases. 
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TABLE  X 

4TH  QOABTEB  QPB  VBBSOS  TIHE  SINCE  COLLEGE 


CATEG. 

NO.FTS 

%-PTS 

Y-MEAN 

Y-DVN 

ID 

CNl 

• 

.50 

.75 

ALL 

159 

1 

3.373 

0.33011 

3.12 

3.36 

3.64 

0-36 

2 

0.012579 

3.595 

0.165 

3.43 

3.43 

3.76 

37-60 

58 

0.36478 

3.3 

0.30956 

3.11 

3.29 

3.47 

61-84 

38 

0.23899 

3.4037 

0.34813 

3.11 

3.39 

3.67 

85-108 

27 

0.16981 

3.38 

0.35614 

3.1 

3.38 

3.64 

109-132 

19 

0.1195 

3.4516 

0.29108 

3.14 

3.48 

3.76 

133-185 

15 

0.09434 

3.436 

0.31117 

3.12 

3.34 

3.79 

The  preceeding  relationships  were  looked  at  to  investi¬ 
gate  the  basic  properties  of  the  variables  studied  and  not 
to  draw  conclusions  on  these  results,  it  would  be  incorrect 
to  draw  the  conclusion  that  these  one  to  one  comparisons 
imply  any  direct  cause  and  effect  without  studying  the 
interactions  of  all  the  variables  concerned.  Chapter  V  will 
investigate  these  relationships  with  an  analysis  of  variance 
approach.  Appendix  D  contains  the  same  figures  and  tables 
for  the  other  three  dependent  variables  (6th  quarter  grad¬ 
uate  gpr,  8th  quarter  graduate  total  gpr  and  8th  quarter 
total  gpr)  . 
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V.  BESOLTS  Of  TBf  ANALYSIS 


A.  APPflOACH  OF  THE  ANALISIS 

This  chapter  describes  the  analysis  techniques  used  and  the 
results  from  the  analysis.  The  analysis  of  the  data  was 
conducted  with  the  aid  of  the  Naval  Postgraduate  School's 
IBM  370  computer  using  an  "ANOVA"  package  designed  by 
Professor  Bussell  Richards  of  the  Naval  Postgraduate  School. 

The  "ANOVA"  package  is  capable  of  performing  multiple 
linear  regression  on  unbalanced  data.  It  is  an  APL  program 
with  many  and  varied  outputs.  Appendix  E  is  an  explanation 
of  the  "ANOVA"  program,  its  capabilities  and  required  input 
data  format.  The  program  uses  the  least  squares  approach 
and  calculations  are  done  in  matrix  format. 

All  of  the  159  students  that  comprised  the  population  of 
this  study  were  included  in  the  analysis  to  develop  a  model 
for  possible  prediction  of  student  performance.  A  cross 
validation  procedure,  using  a  portion  of  the  data,  would 
have  teen  a  useful  technique  to  check  the  validity  of  the 
results.  This  procedure  was  not  employed  due  to  the  limited 
numner  of  academic  prefile  codes  that  were  available  for  the 
study. 

B.  MULTIPLE  LINE  All  B  EGRESSION  ANALYSIS 

Multiple  linear  regression  techniques  were  employed 
using  the  "ANOVA"  program  to  develop  the  explanatory  vari¬ 
ables  to  be  included  in  the  model  and  then  to  estimate  the 
coefficients  describing  the  weights  to  assign  to  the 
variables. 


C.  BCD BI 


The  aodel  used  is  of  the  matrix  form. 


Y  =  XB  +e 


(egn  5.  1) 


where,  Y  is  a  rector  of  dependent  variables 

X  is  a  matrix  of  independent  variables 


B  is  a  vector  of  coefficients 


e  is  a  vector  of  error  terms. 


In  ANOVA  applications  of  linear  models,  the  qualitative 
(main  and  interaction)  effects  are  estimated  on  an  interval 
scale  and  have  arbitrary  origins.  Hence  the  matrix  X  is 
singular.  The  "ANOVA11  package  (Professor  Richards)  solution 
manages  this  problem  by  deletion  of  selected  columns  and 
these  selected  columns  are  listed  for  the  user.  A  selected 
column  represents  an  omitted  variable  whose  estimated  coef¬ 
ficient  is  the  negative  of  the  total  of  all  other  variables 
in  its  category. 


D.  ASSUHPTIOMS  FOB  LINEAR  REGRESSION 


While  using  the  linear  regression  approach,  a  number  of 
assumptions  must  be  made  concerning  the  error  terms.  The 
errors  must  be  independent,  have  zero  mean,  constant  vari¬ 
ance  and  must  be  normally  distributed  [Ref.  7].  Each  time 
the  "ANOVA"  program  was  run  on  a  different  version  of  the 
model  the  residuals  were  plotted  to  verify  these  assump¬ 
tions.  Figure  5.1,  Figure  5.2  and  Figure  5.3  display  these 
results  for  the  particular  model  that  will  later  be  devel¬ 
oped  as  the  study  model  of  choice.  These  figures  and  the 
discussion  in  the  following  paragraph  show  the  assumptions 
are  adequately  met. 

The  variables  included  in  the  model  must  also  be  inde¬ 


pendent. 


The  Pearson's  product  moment  correlation 
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RESIDUALS  FROM  4TH  QTR  MODEL 


SELECTION 

LABEL 

SAfcf-LE  SIZE 
MINIMlU 
MAXIMA! 
CENSOKINO 
EST.  kcrtco 


NORMAL  DISTRIBUTION 


RESIDUALS  FROM  4TH  QTR  UCOCL 
1 59 
-  558 
.829 
NONE 

MAXIMUM  LIKELIHOOD 


MEAN 
STD  DEV 
SKEWIESS 
KURIOSIS 


SAMPLE  FITTEO 
I.4820E-I4  I . 4820E“14 
2.5409EM  2.5409E-T 

I.8I56E-I  O.OOOOEO 
2.5598E0  J.OOOOEO 


cwariance  matrix  of 

PARAMETER  ESTIIAATES 
UJ  SIGMA 

A4J  0  00040351  0 
SIGMA  0  0  00020303 


PERCENT  ILCS  SA4PLE 

FITTEO 

goodness  or 

FIT 

5 

-o  37345 

-4. I804E-1 

CHI -SQUARE 

2  8393 

to 

-0.31989 

-3.2568F-1 

DEO  FREED 

5 

25 

-0. 18835 

-1  7131E-I 

SICNIF 

0.72474 

50 

-0.0083107  2.5665E-8 

KOI  U-CMIRN 

0.044604 

75 

0. 18291 

1.7131E-I 

SIGMIF 

0  90979 

90 

0.35343 

3.256BE-1 

CRamER-V  m 

0.021326 

95 

0.48034 

4. 1804E-I 

SICNIF 

>  .15 

ANOER-RaHL 

0  3336 

SIGNIF 

>  15 

KS.  >0 

Alt)  CV  SICNIF. 

LEVELS  NOT  EXACT  WITH  EST 1  MATEO  PARAMETERS 

0.95  CONFIDEJCE  INTERVALS 

PARAMETER  estimate 

LOWER 

Of’PER 

MJ 

1.4820E- 

14  -0  039379 

0.039379 

SIGAM 

2.5403E- 

1  0.2289 

0.28557 

Figure  5.2  Besidual  Plot  and  Data  :Study  Model. 
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Figure  5.3  Scatter  Plot  of  Residuals  :Study  Model. 


coefficient  (r)  was  calculated  for  the  entire  data  matrix. 


Table  XI  is  the  results  of  these  calculations.  Several  of 


the  variables  vere  looked  at  as  both  main  effects  (qualita¬ 
tive)  and,  after  a  transformation  of  the  data,  as  cofactors 
(quantitative).  In  these  cases  of  correlation  between  two 
scales  of  the  same  variable,  a  high  r  will  be  calculated. 
In  all  other  possible  correlations,  the  r  value  is  low 
enough  to  be  able  to  assume  independence  between  the  vari¬ 
ables  of  the  study. 

The  serial  autocorrelation  statistic  was  used  to  verify 
that  the  error  terms  were  independent.  This  statistic  is 
provided  by  the  output  menu  of  the  "ANOV&"  program.  For  the 
error  terms  to  be  considered  independent,  the  serial 
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TABLE  XI 

COfiBELATIOB  BETVEEH  THE  STOOI  TABIABLES 

Oolumn/Rcw  Title 

1  APC1 

2  APC2 

3  APC3 

4  4th  Qtr  Qpr 

5  „  6th  Qtr  Qpr 

6  8th  Qtr  Qpr 

7  8th  Qtr  Total  Qpr 

8  Col lege  Degree 

9  Designator 

10  Time  Since  College 

11  Refresher  (Yes:  or  no) 

12  College  Rating  (Gourman  scale) 

13  Year  Graduated  NPS 


1  .46  .02  -.38  -.36  -.36  -.39  .10 

1  .25  -.24  -.18  -.18  -.22  -.09 


02 

-.38 

-.36 

-.36 

-.39 

.10 

-.08 

.19  -.16 

.21 

-.11 

25 

-.24 

-.18 

-.18 

-.22 

-.09 

-.11 

.16  -.17 

.16 

.19 

-.15 

-.14 

-.15 

-.16 

.07 

.06 

.02  -.18 

-.21 

.23 

i 

Q1 

Q1 

-  id 

?i 

19  17 

n#; 

1  7 

2 


autocorrelation  statistic  should  be  egual  to  zero  [Bef.  7s 
page  450].  For  the  model  of  choice,  this  statistic  was 
egual  to  .06  and  hence  the  error  terms  are  considered  to  be 
independent. 

&  total  of  forty  different  models  were  analyzed  by  the 
"ANOVA"  package.  The  four  covariance  models  of  highest 
interest  will  be  discussed  individually.  While  these  four 
models  use  the  fourth  guarter  gpr  as  the  dependent  variable, 
each  of ” the  other  three  gpr's  were  analyzed  as  the  dependent 
variable  also.  The  results  of  those  analyses  were  not 
significantly  different  from  the  4th  guarter  models. 

E.  THE  TWO  CO FACT OB  AMO  SIX  NAIM  EFFECTS  HOOEL  WITH 

I IT  EBACTIOMS 

This  model  used  time  since  college  and  college  rating  as 
cofactors  and  the  three  academic  profile  codes,  college 
degree,  refresher  (yes  or  no)  and  year  graduated  from  UPS  as 
main  effects.  The  model  included  the  interactions  between 
APC 1  and  APC2 ,  A  PCI  and  college  degree,  and  college  degree 
and  refresher  (yes  or  no).  Table  XII  is  the  ANOVA  table 
from  the  "ANOVA"  program. 

The  coefficient  of  multiple  determination  (R2)  of  .532 
is  the  highest  of  any  of  the  models  analyzed  in  the  study. 
Thus  this  model  is  able  to  explain  53X  of  the  variability  in 
fourth  guarter  OA  grades  by  Navy  students.  The  model  is 
relatively  significant  (.0  06)  but  only  the  one  variable, 
trme  since  college,  is  individually  significant  above  the 
.05  level  (.029).  None  of  the  interactions  show  any  signif¬ 
icance.  The  covariance  model  is  shown  in  Figure  5.4  . 

Table  XIII  is  a  listing  of  the  beta  coefficients 
provided  as  an  output  from  the  "ANOVA"  program.  It  is 
interesting  to  note  that  the  coefficient  for  tine  since 
college  is  positive. 


TABLE  XII 
ANOVA  TABLE 


R-SCUARE  »  .53  SERIAL  AUTOCORRELATION  =  -.019 


SOURCE  OF  VARIATION  DF 

TOTAL  158 

ERROR  96 

MODEL  62 

XI  TIME  SINCE  COLLEGE  1 

X2  COLLEGE  RATING  1 

FACTOR  1  APCl  4 

FACTOR  2  APC2  3 

FACTOR  3  APC3  5 

FACTOR  4  COL.  DEGREE  6 

FACTOR  5  REFRESHER  1 

FACTOR  6  YR  GRAD  NPS  11 

INTERACTION  1X2  9 

INTERACTION  1X4  16 

INTERACTION  4X5  5 
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MS 

F 
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17.3 
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.11 
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.86 

.492 

.08 

.03 

.31 

.818 
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.82 

.539 
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Figure  5.4  Tuo  Cofactor  and  Six  M/E  Model  with  Interactions. 

F.  TBE  TWO  COFACTOB  S  SIX  BAIN  EFFECTS  MODEL  WITHOUT 
INTERACTIONS 

This  model  is  the  same  as  the  previous  section's  model, 
however,  the  insignificant  interactions  were  not  included. 
Table  XIV  is  the  ANOVA  table  from  the  "ANOVA"  program. 

The  coefficient  of  multiple  determination  (R 2)  has 
decreased  to  .373  but  the  significance  of  the  model  has 
improved  a  bit  to  .0004.  Nov  both  time  since  college 


TABLE  XIII 
BETA  COEFFICIBHTS 


TERM 

COVARIABLES 

m\ 

CONSTANT: 

MAIN  EFFECTS 

FACTOR  (1): 
LEVEL(1 ): 
I£VEL(2): 
LEVEL(3): 
„  LEVEL(4): 

LEVEL(5 ) : 
FACTOR  (2) : 
LEVEL ( 1  : 
LEVEL(2  : 
LEVEL ( 3): 
LEVEL(4): 
FACTOR  (3): 
LEVEL(  1 ) 
LEVEL(2 ) 
LEVEL ( 3 ) 
LEVEL  !  4  j 
LEVEL! 5 ) 
LEVEL(6) 
FACTOR  (4): 
LEVEL!!  : 
LEVEL(2) : 
LEVEL(3  : 
LEVEL(4  : 
LEVEL  5  : 
LEVEL(6): 
LEVEL(7): 
FACTOR  (5): 
LEVEL(l): 
LEVEL<2): 
FACTOR  (6): 
LEVELfl  : 
LEVEL  2): 
LEVEL  3  : 
LEVELv  4 ) : 
LEVEL ( 5 ) : 
LEVEL! 6 ) : 
LEVEL  7  : 
LEVEL(8): 
LEVEL(9): 
LEVEL  10) 
LEVEL(ll) 
INTERACTIONS 

NUMBER  (1): 
LEVEL! 1  : 
LEVEL  2  : 
LEVEL(3  : 
LEVEL  4  : 
LEVEL(5 ) : 
LEVEL! 6 ) : 
LEVEL  7  : 
IEVEL!8  : 
LEVEL(9): 


BETA  COEFFICIENTS 


.025 

.073 

3.642 

APC1 

.203 

-.068 

-.134 

-.142 

.141 

APC2 

.038 

.054 

-.046 

-.046 

APC3 

.019 

-.010 

-.060 

.045 

-.078 

.084 


Time  Since  College 
College  Rating 


APC  Code 

APC0 

APC1 

APC2 

APC  3 

APC4 

APCQ 

APC1 

APC2 

APC3 

APC0 

APC1 

APC2 

APC3 

APC4 

APC5 


COLLEGE  DEGREE 
. 509  Business 
- . 029  Engineering 
.  259  Humanities 
-.017  Math 

-.295  Social  Science 

-.340  Naval  Science 
.087  Operations  Analysis 
REFRESHER 

-.116  Refresher  Yes 

. 116  Refresher  No 

YEAR  GRADUATED  NPS 
-.133  1974 

-.115  1975 

-.056  1976 

.186  1977 

.284  1978 

-.088  1979 

.032  1980 

-.109  1981 

.064  1982 

-.068  1983 

-.042  1984 

APC1  X  APC2  INTERACTIONS 

-.089  1  X  1 

.213  1  X  2 

.032  1X3 

.447  2  X  1 

-.275  2X2 

.125  2X3 

-.073  3  X  1 

-.341  3X2 

.248  4X1 
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TABLE  XIII 

BETA  COEFFICIENTS  (cOQt’d.) 


NUMBER  (2): 

LEVEL(l): 
LEVEL<2  : 
LEVEL  3  : 
LEVEL  4): 
LEVEL  i  5  : 
LEVEL  6  : 
LEVEL  7): 
LEVEL(8) : 
LEVEL  9  : 
LEVEL  10) 
LEVELi 11 
LEVEL  12 
LEVEL  13 
LEVEL  14 
LEVEL!  15 

level! 16) 

NUMBER  (3): 

LEVEL(l): 
LEVEL  2  : 
LEVEL  3): 
LEVEL  4): 
LEVELlS): 


-1.332 

-.660 

-.688 

-.043 

.472 

-.114 

.013 

.377 

.422 

.067 

-.155 

-.085 

.156 

.113 

.311 

.340 


1  X  1 
1X2 
1  X  3 
1  X  4 
1  X  5 

1  X  6 

2  X  1 
2X3 
2X4 
2X5 
3X2 
3X3 
3X6 
4X1 
4X4 
4X5 


4X5  INTERACTION 


.192 

.134 

-.591 

.046 

.025 


1  X  1 
2X1 
3  X  1 
4X1 
5  X  1 


(significance  of  .03)  and  APCl  (significance  of  .005)  are 
seen  to  be  very  significant  factors.  This  version  of  the 
covariance  nodel  is  siiple  with  fever  terns  and  is  shown  in 
Figure  5.5  . 

Table  XV  is  a  listing  of  the  beta  coefficients  provided 
as  an  output  froi  the  "ANOVA"  prograa.  The  levels  of  the 
APCl  variable  are  seen  to  contribute  positively  at  the  first 
two  levels  and  negatively  at  the  lover  three  levels  as  one 
would  logically  expect.  The  APC2  variable  also  "behaves"  in 
a  siailar  fashion  froi  level  one  through  level  four. 


TABLE  ZIT 
AlOf A  TABLE 


R-SQUARE  =  .37 

SERIAL  AUTOCORRELATION  = 

.017 

SOURCE  OF  VARIATION 

DF 

SS 

MS 

F 

SIG 

TOTAL 

158 

17.3 

.109 

ERROR 

126 

10.9 

.09 

MODEL 

32 

6.4 

• 

ro 

o 

2.34 

.0004 

XI  TIME  SINCE  COLLEGE 

1 

.41 

.41 

4.79 

.030 

X2  COLLEGE  RATING 

1 

.12 

.12 

1.43 

.234 

FACTOR  1  APC1 

4 

1.33 

.33 

3.86 

.005 

FACTOR  2  APC2 

3 

.22 

.07 

.84 

.475 

FACTOR  3  APC3 

5 

.35 

.07 

.81 

.547 

FACTOR  4  CDL.  DEGREE 

6 

.92 

.15 

1.79 

.106 

FACTCF  5  REFRESHER 

1 

.00 

.00 

.01 

.974 

FACTOR  6  YR  GRAD  NPS 

11 

.59 

.53 

.62 

.801 

Yi.  =  P*  +  P.  X«*i  t  Psx<’s  +&*  X*  V 

*  Ps^iS  +  P<.  Xt'6  +PfXc7  te.1 


Figure  5.5  Tvo  C/F  and  Six  B/B  Hodel  without  Interactions. 

G.  THE  FOUH  CO  FACT OB  AND  THESE  BAIN  EFFECTS  HODEL  HITH 
I IT  EBACTIOHS 

The  next  uodel  uses  the  variables  tine  since  college , 
college  rating,  year  graduated  from  NFS  and  length  of 
refresher  as  cofactors.  It  includes  APC1,  college  degree 
and  designator  as  oain  effects.  The  aodel  also  evaluates 
the  interaction  between  A  PCI  and  college  degree.  This 
covariance  uodel  has  a  coefficient  of  multiple  deteraination 


TERM 


COVARIABLES 
X(  1 ) : 

X(2) : 
CONSTANT: 

MAIN  EFFECTS 

FACTOR  (1): 
LEVEL(l): 
LEVEL  2 
LEVEL  3 
LEVEL(4 
LEVEL(5 
FACTOR  (2) 
LEVEL (1 
LEVEL  2 
LEVEL ( 3 
LEVEL14 . 
FACTOR  (3): 
LEVEL(l): 
LEVEL  2 
LEVEL  3 
LEVEL  4 
LEVEL(5 
LEVEL(6 . 
FACTOR  (4): 
LEVELfl 
LEVEL (2 
LEVEL  3 
LEVEL(4 
LEVEL  5 
LEVEL  6 
LEVEL(7. 
FACTOR  (5): 
LEVEL! 1 J : 
LEVEL(2): 
FACTOR  (6): 
LEVEL(1 ) : 
LEVEL  2 
LEVEL  3 
LEVEL  4 
LEVEL  5  : 
LEVEL16, 
LEVEL  7, 
LEVELI  8 
LEVEL  9. 
LEVELi 10 
LEVEL  11 
LEVELi 12 


TABLE  Z? 

BETA  COEFFICIENTS 


BETA  COEFFICIENTS 


.026  Tine  Since  College 
.064  College  Rating 

3.371 

APC1  APC  Code 

.352  APCO 

.149  APC1 

-.007  APC2 

-.070  APC 3 

-.424  APC4 

APC2 

.055  APCO 

.054  APC1 

-.032  APC2 

-.077  APC 3 

APC  3 

.  066  APCO 

.026  APC1 

-.072  APC2 

. 007  APC3 

-.095  APC4 

. 068  APC5 

COLLEGE  DEGREE 
.148  Business 

.079  Engineering 

-.166  Humanities 

. 022  Math 

-.099  Social  Science 

-.128  Naval  Science 

.144  Operations  Analysis 
REFRESHER  YES  OR  NO 
-.001  Refresher  Yes 

.001  Refresher  No 

YEAR  GRADUATED  NPS 


-.075 

1974 

-.151 

1975 

.074 

1976 

.105 

1977 

-.048 

1978 

.015 

1979 

.134 

1980 

-.040 

1981 

.006 

1982 

-.055 

1983 

.011 

1984 

.024 

1985 

of  .466  while  the  significance  of  the  model  is  .000026 
significant  variables  were  time  since  college  (.026), 
(.008),  college  degree  (.027)  and  designator.  (.  004). 
XVI  is  the  ANOVA  table  from  the  "ANOVA"  program. 


The 
APC  1 
Table 
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R-SQUARE  =  .47 


TABLE  XTI 
ANOVA  TABLE 

SERIAL  AUTOCORRELATION  = 


SOURCE  OF  VARIATION 

DF 

SS 

MS 

F 

SIG 

TOTAL 

158 

17.3 

.109 

ERROR 

119 

9.3 

.08 

MODEL 

39 

8.1 

.21 

2.66 

.0000 

XI  TIME  SINCE  COLLEGE 

1 

.39 

.39 

5.07 

.026 

X2  COLLEGE  RATING 

1 

.15 

.15 

1.90 

.171 

X3  YR  GRAD  NPS 

1 

.03 

.03 

.37 

.545 

X4  LENGTH  OF  REFRESHER 

1 

.07 

.07 

.87 

.355 

FACTOR  1  APCl 

4 

1.13 

.28 

3.65 

.008 

FACTOR  2  COLLEGE  DEGREE 

6 

1.16 

.19 

2.48 

.027 

FACTOR  3  DESIGNATOR 

8 

1.88 

.23 

3.02 

.004 

INTERACTION  1X2 

17 

1.01 

.06 

.77 

.730 

Cnee  again  the 

interaction 

term 

does  not 

appear 

to  be 

significant.  The  particular  covariance  model  is  shown  in 
Figure  5.6  . 


=  A©  *  v  ^  X 4  E  fftyKty  -t-figY. 

+A  Jft*4  +  &7  *1  7  r  &%  Xi  §  tfif  Xci  Xcz  ♦ 

;  -  1 . /5? 


Figure  5.6  4  Cofactor  and  3  H/E  Model  with  Interactions. 


Table  XVII  is  a  listing  of  the  beta  coefficients  from 
the  "ANCVA"  program.  It  can  be  seen  that  the  variable 
length  of  refresher  contributes  negatively  to  the  overall 
performance  average.  The  APCl  variable  performs  logically 
in  decreasing  order  from  the  0  code  to  the  lower  APCl  code 


TABLE  XVII 
BETA  COEEFICIEHTS 


TERM 

COVARIABLES 
X(  1 ) : 

X  2  : 

X  3  : 

X(4 ) : 
CONSTANT: 

MAIN  EFFECTS 

FACTOR  (1): 
LEVELU): 
LEVEL  2): 
LEVEL  ( 3 ) ; 
LEVEL(4): 
LEVEL] 5  : 
FACTOR  (2): 
LEVELU): 
LEVEL  2  : 
LEVELv  3) : 
LEVELU  : 
LEVEL( 5  : 
LEVEL(6  : 
LEVEL(7): 
FACTOR  (3): 
LEVELU): 
LEVEL  2  : 
LEVEL(3): 
LEVEL (4  : 
LEVEL  5): 
LEVEL (6  : 
LEVEL  7  : 
LEVEL(8  i: 
LEVELU  : 
INTERACTIONS 

NUMBER  (1): 
LEVEL(  1 ) : 
LEVEL12 ) : 
LEVEL (  3 ) : 
LEVELU  : 
LEVEL  5  : 
LEVELU  : 
LEVEL  7): 
LEVEL(8  : 
LEVEIL(  9 ) : 
LEVEL  10  : 
LEVEL  11  : 
LEVEL  12  : 
LEVELU3  : 
LEVEL(14  : 
LEVEL  15  : 
LEVEL(16  : 
LEVEL(17): 


BETA  COEFFICIENTS 


.022  Time  Since  College 

.076  College  Rating 

.005  Year  Graduated  NPS 

-.035  Length  of  Refresher 

3.231 

APC1  APC  Code 

.798  APC0 

.262  APCl 

. 024  APC2 

-.063  APC3 

-1.021  APC4 

COLLEGE  DEGREE 
.376  Business 

.138  Engineering 

-.194  Humanities 

.016  Math 

-.246  Social  Science 

-.251  Naval  Science 

.161  Operations  Analysis 

DESIGNATOR 


-.177 

-.041 

.217 

.117 

.117 

.082 

.056 

.183 

-.554 


1100 

1110 

1120 

1310 

1320 

1400 

1610 

3100 

1130 


APCl  X  APC2  INTERACTION 


-.926 

-.422 

-.385 

.076 

-.437 

-.148 

.014 

2.146 

.300 

-.152 

-.350 

-.030 

.020 

.122 

.148 

.310 

.334 


1  X  1 
1X2 
1X3 
1  X  4 
1  X  5 

1  X  6 

2  X  1 
2X3 
2X4 
2X5 

3  X  1 
3X2 
3X3 
3X6 
4X1 
4X4 
4X5 


ST0D1  BODEL  :THAE2  BAIN  EFFECTS  : FOOB  COFACTORS 
I NTERACTIOBS 


The  interaction  between  the  variables  APCl  anu  college 
degree  was  removed  and  the  resulting  model  is  tne  one 


4  9 


selected  as  the  study  model.  once  again  the  four  cofactors 
are  time  since  college,  college  rating,  year  graduated  from 
NPS  and  length  of  refresher.  The  main  effects  are  the  first 
acadeiic  profile  code  (APC 1) ,  college  degree  and  designator. 
The  model  is  seen  in  Figure  5. 7  . 


i - - - 

Yi  —  Po  + Pt  i  +■  Pi  %£  2  +  Ps  X&3  X  <*5" 

Ai  t  P?  Xi  y  i-€t 

; 5-7 


Figure  5.7  4  Cofactor  and  3  (3/E  (Jodel  without  Interactions. 

Table  XVIII  is  the  ANOVA  table  from  the  "ANOVA"  program. 
The  ccefficient.  of  multiple  determination  is  .408  and  the 
model  has  an  extremely  high  significance  of  .00000007.  This 
model  shows  the  significance  of  time  since  college  (.015), 
APC  1  (.00002),  college  degree  (.032)  and  designator  (.004) 
to  all  be  important  factors  in  explaining  the  variability  in 
fourth  guarter  qpr's  of  students  in  the  OA  curriculum. 

labre  XIX  is  a  listing  of  the  beta  coefficients  from  the 
"ANOVA”  program.  The  cofactors  time  since  college,  college 
rating  and  year  graduated  from  NPS  have  a  positive  contribu¬ 
tion  to  the  fourth  guarter  gpr  while  length  of  refresher 
contributes  negatively.  APCl  behaves  in  a  very  logical 
fashion.  The  better  one's  college  performance  reflects  a 
more  positive  contribution  to  the  dependent  variable  (fourth 
guarter  gpr).  This  same  variable  contributes  in  a  negative 
manner  as  the  college  gpr  decreases  to  the  lower  two  levels. 
The  college  majors  of  business,  engineering,  math  and  opera¬ 
tions  analysis  all  have  a  positive  beta  coefficient  while 
the  social  science,  humanities  and  naval  science  majors  have 

^  n 


REPRODUCED  AT  GOVERN  MEN  (  F.'Srr-MIE 


TABLE  XVIII 
ABOVA  TABLE 


R-SQUARE  =  .41  SERIAL  AUTOCORRELATION  =  .057 


SOURCE  OF  VARIATION 

DF 

SS 

MS 

F 

SIG 

TOTAL 

158 

17.3 

.110 

ERROR 

136 

10.3 

.08 

MODEL 

22 

7.1 

.32 

4.25 

. 00000007 

XI  TIME  SINCE  COLLEGE 

1 

.46 

.46 

6.13 

.015 

X2  COLLEGE  RATING 

1 

.20 

.20 

2.71 

.102 

X3  YR  GRAD  NPS 

1 

.02 

.02 

.30 

.583 

X4  LENGTH  OF  REFRESHER 

1 

.08 

.08 

1.09 

.298 

FACTOR  1  APCl 

4 

2.24 

.56 

7.43 

.000 

FACTOR  2  COLLEGE  DEGREE 

6 

1.08 

.18 

2.39 

.031 

FACTO?  3  DESIGNATOR 

8 

1.79 

.22 

2.96 

.004 

negative  coefficients 

i.  In 

this 

model. 

all  designators 

except  for  1100,1110 

and  1130 

have 

a  positive  beta 

coef fi- 

cient.  Although  this 

model  did  not 

have  the 

highest 

coef fi- 

cient  of  multiple  determination,  it  is  a  straightforward, 
significant  model. 
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TABLE  XIX 
BETA  COEFFICIENTS 


TERM 

BETA  COEFFICIENTS 

COVARIABLES 

X(  1 ) : 

.023 

Time  since  college 

X  2  : 

.083 

College  Rating 

X(3  : 

.004 

Year  Graduated  NPS 

X(4): 

-.037 

Length  of  Refresher 

CONSTANT: 

3.265 

MAIN  EFFECTS 

FACTOR  (] 

.): 

APCl 

LEVEL 

1) 

:  .351 

APC0 

LEVEL 

2 

:  .195 

APCl 

LEVEL 

3 

:  .001 

APC2 

LEVEL 

4 

:  -.114 

APC3 

LEVEL 

5) 

:  -.433 

APC4 

FACTOR  (2 

): 

COLLEGE  DEGREE 

LEVEL(l) 

:  .061 

Business 

LEVEL (2 ) 

:  .138 

Engineering 

LEVEL! 

3 

-.175 

Humanities 

LEVEL! 

4 

:  .033 

Math 

LEVEL 

5) 

:  -.097 

Social  Science 

LEVEL! 

6 

:  -.101 

Naval  Science 

LEVEL(7 ) 

:  .141 

Operations  Analysis 

FACTOR  (3): 

DESIGNATOR 

LEVEL! 1) 

:  -.091 

1100 

LEVEL(2 

-.045 

1110 

LEVEL! 3 ) 

:  .218 

1120 

LEVEL! 

4 

:  .100 

1310 

LEVEL(5 ) 

:  .117 

1320 

LEVEL! 

6) 

:  .072 

1400 

LEVELl 

7 

:  .030 

1610 

LEVEL! 

8 

:  .148 

3100 

LEVEL(9) 

:  -.549 

1130 

&.  CCICLOSIOMS 


The  study  shows  some  interesting  insights  into  evalu¬ 
ating  future  performance  in  regards  to  the  Operations 
Analysis  curriculum.  It  would  initially  seem  quite  logical 
to  assume  that  the  longer  an  individual  has  been  out  of 
college  the  harder  it  would  le  for  him  or  her  to  return  and 
succeed  in  the  academic  environment.  However,  this  does  not 
appear  to  be  the  case  as  reflected  by  this  study.  In 
searching  for  an  explanation,  motivation  could  play  a  major 
role.  Those  students  who  start  a  curriculum  middle  to  late 
in  their  military  service,  have  most  likely  decided  to  make 
the  service  a  career.  They  are  likely  to  realize  how  impor¬ 
tant  successful  completion  of  their  chosen  subspecialty  is 
to  their  remaining  time  in  the  service  and  are  consequently 
willing  and  ready  to  make  whatever  effort  is  required  to 
accomplish  that  goal.  More  correctly,  they  are  out  to  do 
the  best  they  can  possibly  do  while  earning  their  degree. 
This  grouping  would  also  imply  that  they  are  most  probably 
of  an  age  to  have  their  families  and  a  maturity  to  be  able 
to  concentrate  their  efforts  toward  a  long  term  goal. 

In  almost  every  model  tested,  the  variable  for  college 
academic  performance  (APC1)  was  seen  to  be  a  significant 
factor.  Surprisingly,  the  math  (APC2)  and  technical  code 
(APC 3)  did  not  prove  to  be  very  meaningful  in  the  manner  of 
explaining  the  variability  of  student  performance.  Gxven  a 
choice  it  appears  to  be  more  logical  to  select  a  student 
based  on  his  performance  in  his  chosen  field  rather  than  to 
strictly  choose  based  on  his  undergraduate  degree. 


The  negative  contribution  ox  length  of  refresher  prob¬ 
ably  means  those  individuals  who  need  it  most  are  in  fact 
getting  the  extra  quarter  or  two.  This  is  possibly 
confounded  by  the  ability  to  get  an  extra  guarter  or  two 
"after  the  fact",  in  that,  early  poor  performance  can  "flag" 
a  student  and  draw  attention  to  him.  With  liasion  between 
the  curricular  officer  and  the  student's  detailor,  an  addi¬ 
tional  guarter  or  two  can  get  added  to  his  tour  at  NPS. 

With  the  possible  exception  of  business  majors,  there 
are  nc  surprises  in  the  college  degree  variable.  Those 
students  with  college  majors  of  math,  engineering,  opera¬ 
tions  analysis  and  business  in  fact  nave  performed  as  an 
average  better  than  the  humanities  and  social  science 
ma  j  ors. 

The  designator  variable  was  in  fact  significant  to  the 
model  and  showed  the  designators  1100,  1110  and  1130  to  have 
a  negative  contribution  toward  fourth  guarter  academic 
performance. 

lie  study  population  covered  only  those  students  who 
successfully  completed  the  OA  curriculum.  Of  course  one 
would  want  to  infer  that  the  insights  gained  from  the  study 
group  would  apply  to  the  target  group  of  future  OA  students. 
This  can  not  be  done  in  the  strict  predictive  sense  but  the 
study  can  suggest  that  any  selection  of  future  OA  students 
be  influenced  by  these  results. 

The  model  preferred  by  the  author  is  discussed  in 
section  H  of  Chapter  V.  This  model  has  an  R2  value  of  .41 
while  another  model  investigated  (section  E  of  chapter  V) 
attains  an  R2  of  .53.  The  model  of  section  H  has  a  much 
higher  level  of  significance  and  is  a  simpler  less  complex 
model. 


B.  B  ECOflHEMDATIOIS 


A  very  interesting  study  to  complement  this  one  would  be 
to  investigate  those  Navy  students  who  started  but  did  not 
complete  the  OA  curriculum  during  the  last  ten  years.  The 
study  group  would  not  be  very  large  but  it  could  possibly 
provide  additional  insight  into  the  problem. 

Becent  interest  has  been  generated  to  have  all  NPS 
students  take  the  Graduate  Record  Examination  (GBE) . 
Currently,  this  predictor  is  available  for  very  few  individ¬ 
uals  in  this  study.  Exactly  when  the  test  will  be  taken  is 
still  to  be  determined  but  a  study  combining  academic 
profile  codes  and  the  GBE  could  prove  to  be  much  more 
successful  in  developing  a  predictive  model.  In  this 
regard,  the  recommendation  that  the  APC*s  and  GBE  scores  be 
maintained  by  NPS  as  a  permanent  part  of  the  student*s  tran¬ 
script  is  a  necessity  for  future  studies  of  this  type. 

Another  study  of  interest  would  be  to  determine  the 
validity  and  usefulness  of  the  newly  established  Technical 
Transition  Program.  This  new  program  will  reguire  a  few 
years  before  the  data  can  be  collected  studied  but  adequate 
records  must  be  maintained  in  order  to  evaluate  it  in  the 
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ACRONYMS  AND  ABBREVIATIONS 

APC  Academic  Profile  Code 

APCl  Academic  Profile  Code  1st  Digit 

APC2  Academic  Profile  Code  2nd  Digit 

APC3  Academic  Profile  Code  3rd  Digit 

ARE  Academic  Record  Evaluation 

GRE  .Graduate  Record  Examination 

NMPC  Naval  Military  Personnel  Command 

NPS  Naval  Postgraduate  School 

OA  Operations  Analysis 

QPR  Quality  Point  Rating 

r  Pearson's  Product  Moment  Correlation  Coefficient 

R2  Coefficient  of  Multiple  Determination 

Technical  Transition  Program 


TTP 


APPENDIX  C 
THE  STUDY  DATA 


Column 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 


11 


12 

13 

14 

15 

16 

17 

18 


Index 


APCl 

APC2 

APC3 

4th  QTR  QPR 

6th  QTR  QRAD  QER 

8th  QflR  Ibtal  ®AD  QPR 

8th  QTO  Total  QPR 

College  Rating  —  Main  Effect 

College  Degree 

3  =  Business 

6  =  Engineering 

7  =  Humanities 

8  =  Math 

9  =  Social  Science 

10  =  Naval  Science 

11  =  OA 


Designator 

1  =  110X 

2  =  11 IX 

3  =  112X 

4  =  131X 

5  =  132X 

6  =  140X 

7  =  161X 

8  =  310X 

9  =  113X 
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Figure  D. 12  8th  Qtr  Total  QPB  vs  College  Degree. 
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Figure  D. 14  8th  Qtr  Grad  QPB  vs  Designator. 
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APPENDIX  E 


Welcome  to  the  Anova  package. 

This  package  was  developed  by  Prof.  Russell  Richards  at  NPS.  The 
latest  revision  occurred  on  May  21,  1985.  Please  provide  your  comments 
to  Prof.  Richards  in  Root  271. 

Type  DESCRIBE  for  basic  documentation.  Other  instructions  are 
obtained  by  typing: 

EXTRACTHCW  (explains  the  use  of  the  function  extract) 
GLOBAL  (lists  the  global  variables  in  the  workspace) 
SYNTAX  (shews  the  syntax  for  use  of  several  functions) 

In  addition,  the  function  called,  AOVUTY,  provides  a  menu  of 
options  which  should  be  somewhat  self-explanatory. 

This  package  is  still  under  development. 

To  use  the  general  linear  model  package  for  analysis  of  variance, 
you  must  first  enter  your  data  in  the  form  required.  Your  need  an  N  X 
1  array,  Y,  containing  the  observed  values  of  the  dependent  variables, 
an  N  X  NGOV  array,  00V.  containing  the  values  of  the  NOOV  oo variables 
(NCOV  may  be  0),  and  an  N  X  NF  array,  data  containing  the  subscripts  of 
the  NF  factors  to  be  considered  in  the  analysis.  Note:  The  columns  of 
data  contain  subscripts  which  must  be  integers  1,  2,  ...,  M  where  M  is 
the  number  of  levels  of  a  factor.  You  can  execute  the  function  called 
RECODE  to  rewrite  the  values  in  data  so  that  they  satisfy  this 
requirement  (simply  type  RECODE).  The  function  named  EXTRACT  may  be 
useful  for  creating  these  arrays  if  the  data  can  be  extracted  from  a 
larger  array  which  contains  the  necessary  data.  Type  EXTRACTHOW  for 
info  on  the  use  of  extract.  If  you  want  to  enter  the  data  at  the 


terminal,  you  can  use  the  function  called  INPUT. 

After  the  necessary  data  are  entered  into  the  workspace, 
type  RUN  0  to  begin  the  analysis  (the  argument  0  indicates  the  initial 
run  with  the  given  data;  for  subsequent  runs  using  the  same  data,  enter 
RUN  1).  For  the  first  run  with  a  given  set  of  data  you  will  be 
prompted  to  enter  various  information  needed  by  the  program.  This 
information  includes  names  for  the  factors,  covariables,  and  for  the 
job.  It  also  asks  if  you  want  to  transform  the  data.  If  so,  the 
original  values  of  the  dependent  variable  are  stored  in  the  array  OIDY 
and  a  new  Y  array  is  created. 

With  the  initialization  completed,  you  will  be  asked  to  enter  the 
interactions  desired  to  be  included  in  the  analysis  (if  any).  You 
should  enter  the  interactions  by  typing  a  vector  containing  the  numbers 
of  the  factors  which  comprise  the  interactions.  For  example,  if  you 
want  to  include  interactions  between  factors  1  and  2;  factors  1  and  3; 
and  factors  1,  2,  and  3  you  should  enter  the  vector  12  13  123. 

The  program  then  performs  the  following  tasks: 

1.  A  matrix  D  having  N  rows  and  a  number  of  columns  which  depends  cn 
the  number  of  levels  of  each  of  the  NF  factors  is  generated.  This  is 
the  portion  of  the  design  matrix  corresponding  to  the  main  effects.  It 
contains  only  the  values  0,  2,  and  -1.  The  main  effects  are 
automatically  normalized  so  that  the  rain  effects  sum  to  0.  A 
bookkeeping  array,  DF,  of  size  NF  x  2  is  also  generated.  The  elements 
of  the  ith  row  of  BF  indicate  which  cols  of  D  correspond  to  the  ith 


factor . 


2.  An  array,  DD  containing  N  rows  is  generated.  The  number  of 


m 


cols  of  CD  depends  on  the  number  of  interactions  and  the  number  of 
levels  of  each  interaction.  DD  is  that  portion  of  the  overall  design 
matrix  which  corresponds  to  the  interaction  terms.  Like  D,  DD  contains 
only  the  values  0,  1,  and  -1.  A  scalar,  NI,  indicating  the  number  of 
interactions  is  created,  and  a  bookkeeping  array,  Bl  of  size  NI  X  2  is 
generated.  It  indicates  which  cols  of  DD  correspond  to  which 


interactions. 


3.  The  overall  design  matrix  X,  is  generated  by  catenating  COV, 


D,  and  DD. 

4.  The  design  matrix  is  checked  to  see  if  it  is  nonsingular,  if 
not  nonsingular,  the  rank  is  determined  and  a  set  of  cols  that  can  be 
eliminated  is  indicated.  If  the  design  matrix  can  be  made  nonsingular 

by  elimination  of  one  or  more  ools  from  the  interaction  set,  that  is 
done  automatically.  If  not,  program  execution  terminates. 

5.  The  analysis  of  variance  is  performed  on  the  model,  Y  =  XBETA. 
Output  consists  of  the  R-squared  statistic,  the  ANOVA  table  with  the 
covariable  effects.  The  main  effects  and  the  interaction  effects  all 
indicated.  For  each  effect,  the  degrees  of  freedom,  the  sum  of 

squares,  the  mean  square,  and  an  F  ratio  are  presented.  The  error  and 
total  sums  of  squares  and  degrees  of  freedom  are  also  given.  Finally, 
summary  statistics  for  each  of  the  covariables  and  for  the  dependent 
variable  for  each  level  of  each  of  the  main  effects  are  provided.  This 
information  consists  of  the  observation  counts.  The  mean,  the 
variance ,  and  the  standard  deviation.  The  summary  statistics  are  given 
for  the  original  data,  not  the  transformed  data. 

6.  Available  at  the  conclusion  of  the  run  is  a  GLOBAL  vector  called 


1  *  W W 


BETA  which  contains  the  estimates  of  the  parameters  included  in  the 
full  model. 

7.  After  the  analysis  of  variance  is  performed,  various  utility 
functions  can  be  performed  on  the  output  by  executing  the  function,  AOVUTY. 
That  function  presents  a  menu  of  your  choices.  The  function  called  EXTRACT 
can  be  used  to  create  the  input  arrays  required  by  the  ANOVA  package. 

It  should  be  used  when  you  already  have  an  array  from  which  all  of  the 
required  data  can  be  extracted.  The  syntax  of  the  function  is: 

EXTRACT  DATA 

Where  data  is  a  two-dimensional  array. 

The  EXTRACT  function  will  prompt  the  user  for  the  inf orrraticn  it 
requires.  The  user  nust  know  which  columns  of  data  correspond  to  the 
data  that  he  wants  to  extract. 

One  of  the  questions  asked  is  the  column  of  the  selection  variable. 

It  is  assumed  that  the  user  wants  to  select  only  specific  rows  of  data 
corresponding  to  values  of  a  selection  variable.  For  example,  suppose  the 
third  column  of  data  contains  1  or  2  with  1  representing  males  and  2  females. 
If  the  analysis  is  to  be  performed  on  rales  only  we  select  those 
observations  with  a  1  in  column  3 . 

The  values  of  the  variables  in  the  columns  that  are  used  to  refer  to 
factors  must  be  integers  1,  2,  3,  ...  etc.  that  will  be  used  by  this 
package  as  subscripts  (factor  level  indicators). 

After  using  EXTRACT  to  create  the  input  data  arrays,  the  user  can  then 
perform  the  analysis  of  variance  by  typing  RUN  0. 

The  syntax  of  the  major  functions  in  the  ANOVA  package  are: 

EXTRACT  ARRAY  (Extracts  the  required  data  from  array) 


RECODE 


(Operates  on  the  GLOBAL  array  data) 

INPUT  (Creates  the  arrays  needed  for  run) 

RUN  K  (K  is  0,  1,  or  2) 

AOVUTY  GLOBAL  (Consists  of  various  useful  utility  functions) 

This  provides  a  description  of  the  GLOBAL  variables  used  by  the  ANOVA 
package.  The  convention  used  in  naming  GLOBALvariables  is  to  always 
use  underscored  names  for  GLOBAL  variables. 

Y  -  The  vector  of  values  of  the  dependent  variable. 

N  -  The  number  of  observations  in  Y. 

NOOV  -  The  number  of  covariables  to  be  considered. 

COV  -  The  array  of  size  N  by  NCOV  containing  the  values  of  the  NF. 

NF  -  The  number  of  factors  to  be  considered. 

DATA  -  The  array  of  size  N  by  NF  containing  the  subscripts  of  the 
NF  factors  for  each  of  the  N  observations. 

D  -  The  design  matrix  containing  N  rows  of  the  values  0,  1,  and 
-1  corresponding  to  the  main  effects  to  be  considered  in  the  model. 

The  number  of  ools  of  D  depends  on  the  number  of  levels  of  the  NF  factors. 
A  factor  having  K  levels  will  have  K-l  cols  in  D.  K-l  dumny  variables  will 
be  defined  with  values  0  or  1.  The  Kth  level  is  defined  so  that  the  sum 
of  the  effects  is  zero. 

BG  -  This  is  an  array  of  size  NF  by  2  containing  bookkeeping  info 
concerning  which  factors  correspond  to  which  columns  of  D. 

DD  -  This  is  an  array  of  N  rows  containing  the  portion  of  the  overall 
design  matrix  corresponding  to  the  interactions  to  be  considered. 

It  consists  entirely  of  the  values  0,  1,  and  -1.  The  number  of  ools  of  DD 
depends  on  the  factors  and  interactions  considered. 
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